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METHOD AND APPARATUS FOR configuration, storing frequently used values in a sialic 

ALLOCATING BANDWIDTH IN random access memory or other memory array, Ihe cache in 

TELECONFERENCING APPLICATIONS some configurations being coupled directly lo main memory 

USING BANDWIDTH CONTROL Various other intelligent cards may be connected to the 

5 bus 301, including direct memory access devices. 

BACKGROUND OF THE INVENTION Also shown in FIG. 2, various peripherals exchange 

„ , - . information via bus 301 with the processor 302, main 

Teleconferencmg systems among computer systems or ^ ^^^^ ^ 30^^^ ^ 

work stations have become a common means for exchanging ^^^ -^^ y^ese peripherals include a display 321, and 

ideas among work groups of people located in difterent ^^^^^ ^^^^^ generally a video monitor or printer 329. 

locations. Teleconferencing systems mimic actual meetings, ^ keyboard 322 is also coupled to the bus 301, permitting 

m that the human users can see one another and talk lo one alphanumeric entrv. A cursor control 323 coupled to the bus 

another m real-time, without having to type in their mes- 3Q1 ^e configured as a mouse or track ball. A sound 

sages into a keyboard or di.splay respoases as text on a ^^^^^^ ^^^^^^ 321^ also coupled to the bus 301, may be 

monitor or a printer. Teleconferencing also allows mulu- configured as a loud speaker or a number of loud speakers. 

party communication, both in multi-directional conversa- ^ ^^^^ -^^^^ ^^^-^^ 325 j^^y be configured as a video 

tions and in broadcast from one location to many locations. camera, a scanner, a fax input, or similar device, and is 

A network may be a local network connecting a few coupled to the processor 302 via bus 301. A sound input 

machines to one another, or a much wider network connect- device 326, also coupled to the bus, may be configured as a 

ing large numbers of different types of machines. Many microphone or a sound synthesizer, or may be a telephone 

networks, especially wide area networks, connect machines connector. A network or communication medium connector 

operating on different platforms, but provide consistent 342 allows communication between any of the above 

protocols to allow the machines to communicate. Various devices and a network or communication medium. Finally, 

approaches to networking are known in the art, including a communication device 327, also coupled to the bus 301, 

distributed networks and centrally administrative networks. ^ allows communication between any of the above devices 

FIG. 1 shows one example of a network. Processors 150C and the network (or other communication) medium 170 via 

and 155C are each connected via a network adapter 160 and the network/communication adapter 160. In some 

165, respectively, to a network medium 170. ITie network embodiments, the networking medium is a digital commu- 

\2 medium 170 may be a digital bus, a video coaxial cable, a nication medium, allowing high speed digital communica- 

telephone line, a fiber optic cable, or any other medium 3Q tion beUveen computer systems over the network. 

pjj through which information may be transferred from one Various network configurations are known in the art: star 

fs location to another. It will be understood upon reference to configurations, daisy-chained networks, etc. The computer 

FIG. 1 that other arrangements are possible, that the network system, in some embodiments, is connected via a network 

S may include more than two computer systems, and that each adapter lo a network medium lhal allows the computer 

s of the processors 150C and 155C may be connected via 35 system to communicate with other computer systems at 

1 a other network adapters to other network media. other locations. The other systems may be coupled to the 

r? Each of the processors in the computer systems shown in same medium substrate, or may be connected to other 

FIG. 1 has a video monitor at 150D and 155D, a video input processors or intelligent devices that are in turn connected to 

Q 150A and 155A, an audio input 150B and 155B, a keyboard the substrate. 

^fl input ISOe and 155e having a mouse, and possibly other 40 A processor or processors of the computer system as used ■ 
S peripheral input output devices connected thereto. It will be in one embodiment of the present invention generally has 
understood that each computer system may also comprise software operating thereon, including teleconferencing 
^ multiple processors sharing a network adapter, forming a applications. Data is transferred over the network by the 
local network within the larger network shown in FIG. 1. teleconferencing applications, including but not limited to. 
Computer systems such as 150 and 155 may connect to a 45 voice, video, and other data. The data may have been created 
number of network media having differing types of media by the same application that created it, or may have been 
substrates, and further having different network protocols. created by another application. Other applications may also 
Processor 150C and 155C each display images on the video be operating on the computer system, sending or receivii^ 
monitor 150lD and 155D, respectively, and receive inputs documents, for example. Also, other teleconferences may be 
from olher peripherals. Processors may also be running 50 ongoing at the same time, each supported on the same- 
computer programs, including application programs and network. When several teleconferences are ongoing at any 
transport layer programs, that may call one another and given time over the same network, it may be that each 
serve one another, exchanging data, addresses, and control includes a different subset of the sets of computer systems 
signals. connected to the network. Teleconferencing applications 
One embodiment of a possible computer system operating 55 often also allow other computer systems to join ongoing 
according to one embodiment of the present invention, is teleconferences by selecting which teleconference a user at 
shown in FIG. 2. A processor 302 is connected via a system the other computer systems wants to call, or drop out of 
bus 301 to a main memory 304, a read only memory 306, teleconferences by terminating connections, 
and a mass storage device 307. The main memory may be a FIG. 3 illustrates a hierarchy of programs or of levels of 
volatile memory array composed of dynamic random access 60 absiraction in a single program, allowing an application lo 
memory. The read only memory 306 may be composed of a communicate over a network. The application program 401 
CD ROM, an initialization cache, erasable programmable includes a presentation layer and a human user interface for 
read only memory, EEPROM, flash memory, or other read exchanging inforriiation with a human user. Various appli- 
ohly memories. The mass storage device 307 may be con- cations programs may call software at conferencing layer 
figured as a disk drive writing lo, and reading from, hard 65 400 that has its own protocols for exchanging information 
disks, floppy disks, or olher storage devices. Processor 302 with the application and with the lower layers of the com- 
may also have a cache, either a write back or read through munication system. The conferencing layer software used by 
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a particular application program parses the information a particular teleconference, running in a particular applica- 
exchanged with the human user into messages provided to tion or copy thereof, is the "fan out" of the teleconference 
one or more transport components 402. Each transport layer message. When the nuhiber of parlies to a teleconference 
exchanges information with the conference layer, and pro- becomes very large, the fan out becomes very large as well, 
vides packets of information suitable for a particular net- 5 'JTiis can burden the network, since each teleconference 
work component 403. The network layer exchanges infor- within each application may require a separate message to 
mation with the transport layer, and provides data in a form be sent to each other system participating in the tclcconfcr- 
appropriate through a system network component to the ence. Some teleconferencing applications do not have 
network adapter 160. "multi-cast", which is a feature that allows a single message 
Among the apph'cations that may be run on a processor to be received by multiple nodes on a network, but some 
are teleconferencing applications. Teleconferencing applica- teleconferences must send a separate message to each other 
tions generally allow a user to view video images, send participant in a teleconference, imposing an enormous bur- 
video images, and/or send and receive audio over a network, den on the network transport layer programs when the 
generally in real time. Real-time requires not only data number of nodes participating in the teleconference Is high, 
transmission of a fairly large amount of data, but also ^ ^^en several teleconferences or other network-using 
requires a high degree of synchronization among the data applications are ongoing simultaneously, 
when packets are reconstructed by a receiver system; if a Excessive bandwidth use by any given connection pre- 
voice, for example, arrives before a video image of a person another problem. Teleconferencmg systems and other 
speaking, the sound and video must be synchronized when ^^^^uui'^ Tl I^'* "^P"""*- 
presented by the application running on the receiver system. able bandwidth^For example, teleconferencmg systems may 
r, . , jx • . * 1 J- 20 send video updates as frequently as is possible given a 
Voice (or other sound) video, and other signals, mcludin^ particular bandwidth availability. Some flow control 
control signals, inust be presented to the higher-layer at a ^^^^^^ ^^-^^ bandwidth on a first-come, first-served 
^ proper tunmg to have the proper meamng. approach among the applications, and later-initiated network 
Q Problems arise, however, when a large number of appli- applications must wait in a "queue" until earlier applications 
PI cations on a given network node generate signals for trans- 25 have completed transmission or receipt of the network 
^ mission across a network or other communication medium. message. Because teleconferencing applications generally 
• For example, when a particular computer or workstation is do not have flow control while other network applications 
running several teleconferencing applications frequently do, the non-teleconferencing applications can be 
I* 5 simultaneously, or running several other applications that slowed down tremendously when teleconferencing is in use. 

similarly require network bandwidth, the applications vie for 3Q Other network transmission applications, for example, fax- 
sf=5 access to the network against one another. It will be under- ing of documents, can compete with the video or audio 
stood that "network" refers generally to any shared com- teleconferencing systems for bandwidth, and together with 
munication pathway from one system to another, and spe- such systems can occupy all available bandwidth. Most 
^ cifically to a shared communication pathway of limited data non-teleconferencing applications have an internal flow con- 
capacity in terms of bandwidth or data rate. Generally, each 35 trol that identifies bandwidth limits and reduces data rate 
|s& layer of software, including the transport layer and other accordingly; however, the methods used are not appropriate 
lower level communication layers, like the hardware, have for real time teleconferencing applications. Such other file 
^ bandwidth restrictions limiting the amount of information transfers occupy bandwidth as well. When an aggressive 
^ that may be provided from any given system to the network application sends excessive numbers of video update frames 
g in a given period of time. Therefore, applications compete 40 or otherwise occupies bandwidth that can better be allocated 
^ ; for output bandwidth against one another, and in many to other applications, the other applications (such as file 
' systems the first to claim a bandwidth can use that band- transfer, faxing, etc.) slow the rate at which the non- 
width to the exclusion of other applications. teleconferencing applications send data. Teleconferencing 
The problem is especially acute when a teleconferencing applications generally do not have flow control features, and 
application is used, in that teleconferencing applications 45 so provide data to a network or communication/transmission 
require such a large bandwidth commitment, and generally medium at an rate that is less predictable. Teleconferencing 
lack flow control that would limit the flow of data from the applications can easily slow down other applications to an 
application to the network when the network is heavily used. almost stand-still rate. 

Sharing bandwidth fairly is a practical concern. A network Application-specific solutions are not enough to solve the 
may include any number of systems. A network may also 50 problem. Even node-specific solutions cannot eliminate the 
include multiple simultaneous teleconferences. A particular problem. Some application-specific. flow control processes 
system on the network may be involved in more than one switch to better compression algorithms, transmit fewer 
simultaneous teleconference; the teleconferences may be updates, transmit sound in mono instead of stereo, require a 
running imder different applications, or under different cop- smaller video window, or otherwise reduce bandwidth con- 
ies of the same teleconference. Multiple applications or 55 sumption when bandwidth is at a premium. However, these 
other processes on a computer system may have access to a systems only affect bandwidth use by the application itself, 
network or other communications medium. Any given tele- and do not accommodate other applications, 
conference may require a system to provide teleconferenc- Error-correcting protocols are not appropriate for real- 
ing messages to any number of the other systems on the time applications. These protocols are useful in correctly 
network. The simultaneous teleconferences at a given sys- eo transmitting files having exact information, such as a spread- 
tem may run under different teleconferencing applications, sheets or other documents, in which small errors must be 
compression schemes, and update rates, and the different corrected and re-transmissions do not create problems, and 
messages may be addressed to different nodes on the so are commonly available among transport layer programs, 
network, and to any number of nodes. All of these increase Error-correcting protocols, such as most transport- layer 
the use of bandwidth by a system. 65 protocols, are inappropriate for conferencing or other real- 
The number of recipients of a particular message, sent time applications. Error correcting protocols require 
over the network from a particular system, in the context of re-transmission of erroneous packets of data. 
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Therefore, ii is desirable for a system to be found that can FIG. 10 shows a memory array storing steps to be 

allocate bandwidth among applications to prevent one appli- performed at the client (non-adminislrator) node, 

cation from excluding other applications from the nelworic. piG. 11 shows a memory array storing steps to be 

Also, because an application running on one workstation or perfonmed at the administrator node. 

computer can reduce bandwidth available to other computer 5 

systems and to other users when systems share access to a DEIAILHD DESCRIPIION 
common network or other communication medium, it is jn |he present description, the terms "computer system", 
desirable to have a central control for administration of the "work station", "machine", and "node" will be used inter- 
bandwidth allocation to prevent an application from inter- changeably so as not to obscure the present invention 
fering with other applications. It is also desirable to protect 10 needlessly. It will be understood that any of these may be 
the bandwidth allocation from manipulation at the worksta- replaced with a plurality thereof, or may be replaced with 
lion itself, to prevent users from changing the allocation other intelligent systems such as servers, remote dedicated 
once it is established. It is also desirable to allow network machines. Computer systems, dedicated servers, work 
management process to manipulate or aUer the variables as stations, and other machines may be connected to one 
needed. 15 another across networks. For simplicity of explanation, the 

terms "machine", "computer system", "work station", and 
"node", will be used interchangeably, ahhough it will be 
In the present invention, in some embodiments, an admin- understood that each may refer to a single intelligent system 
istrator a.ssigns a total bandwidth allocation to at least one or to a distributed sub-network sharing a network adapter to 
other computer system, and the computer system parcels the 20 the network administrated by the described network admin- 
bandwidth among the applications running on the computer istrator. 

system. In the operation of one embodiment of the present A portion of the disclosure of this patent document 

invention, an administrator sends a bandwidth maximum contains material which is subject to copyright protection, 

allocation to each node on the system. Each node determines The copyright owner has no objection to the facsimile 

a current bandwidth being used, and limits the current 25 reproduction by anyone of the patent disclosure, as it 

bandwidth to this allocation. Thereafter, each node then appears in the Patent and Trademark Of&ce patent files or 

reallocates its usable bandwidth among applications running records, but otherwise reserves all copyright rights whatso- 

on the nodes that are attempting to send messages over the ever. Copyright Apple Computer, Inc. 

network. For each appHcation, a current bandwidth use is jn a network-level aspect of the present invention, a cUent 

determined, as well as a current bandwidth demand. The ^ system receives a value from an administrator node and 

current bandwidth demand is the amount of bandwidth that determines the bandwidth allocation, 

the application would be using if no other applications were ^ ^^^^^^ administrator node is a computer system on a 

runnmg on the node and if there were no hmitations on the ^^^^^^j^ ^^^^ ^^^^^^^ ^^^^^^^ ^^^^^ ^^^^^ ^^^^3 ^„ j^e 

amount of data the application could send to the network^ A ^^^^ network. A network administrator node must exchange 

ratio IS calculated to determine the amount of the bandwidth 35 ^^^^^^^^^ ^^^^ ^^^^ ^„ ^^^^^^^ hov^cwf^r, 

demand currently being satisfied for each application, thus ^^^^ ^^^^ higher priority uses of the network bandwidth 

calculatmg the happmess factor for the apphcation. ^^-^^ ^ ^^^^^^ ^^^^ ^^^^ ^^^^ 1^^^^ p^^^jy ^ 

FIELD OF THE INVENTION However, the network administrator must also be able to 

^ limit network access by aggressive though low priority 

TTie present invention relates to computer networks, and applications, or a low priority application use might capture 

more specifically to network administration. the network, preventing higher priority users from gaining 

RRIFF np<;rRiPnnM access. Also, within each computer system, various imelli- 

tiKit^t ut^L^Kif iiuiN gg^j components must share access to the network adapter, 

FIG. 1 shows one example of a network. 45 often requiring local arbitration of network demands. 

FIG. 2 shows one embodiment of a possible computer Although local arbitration may be performed by the 

system operating according to one embodiment of the computer system itself, a central network administrator in a 

present invention. centrally administrated network prevents usurpation of the 

FIG. 3 illustrates a hierarchy of programs or of levels of network bandwidth by limiting network access of each 

abstraction in a single program, allowing an application to 50 computer system on the network. The admmistration of the 

communicate over a network. network is flexible, however, in that a read only variable 

no. 4 shows a managed network of nodes comprising P^^^^^.^^ to the network by the co^^^^^^^^ 

work stations or other computer systems and permitting a ^dmimstrator of the bandwidth of the messages the vanous 

number of teleconferences to operate over the network programs and processors are trying to put on to the nctwoik. 

among the nodes. 55 The apphcations transfer data by calling other lower-level 

xTir^ c u r»i .TT • T» J j.u 1 ♦J programs on the computer system that convert the data into 

FIG. 5 shows BlueDoiUsineBandwidth as implemented ^ , r _ir o. jj* 1. 

. »o.u a °5ore easily transferred form. Standard forms are packets 

according to one embodiment of the present invention. r j . . u r • r» 1 * r j * 

/ L .T , . of data, that may be of any size. Packets of data are 

FIG. 6 shows Ujxlate Values as miplemented accordmg to transferred to the network from the computer system via a 

one embodiment of the present invention. transport layer protocol specific to the network medium and 

FIG. 7 shows BlueDotGimmeBandwidth as implemented to the computer system, 

according to one embodiment of the present invention. 4 ^hows a managed network of nodes comprising 

FIGS. 8A, 8B, and 8C show Update allocations as imple- work stations or other computer systems and permiuing a 

mented according to one embodiment of the present inven- number of teleconferences to operate over the network 

^ion 65 among the nodes. Systems 501-517 are individually coupled 

FIG. 9 shows BlueDotQueryHappiness as implemented to one or more network media, allowing communication 

according to one embodiment of the present invention. over the network. Some systems 5(13, 505 appear on more 
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than one network, and may allow communications between in more than one teleconference (or other application requir- 
one network and another. For example, system 503 can ing sending messages to the network), the allocated band- 
provide data to, and receive data from, network or coramu- width is further allocated among the various teleconferenc- 
nications media 530 and 532, or can facilitate exchange of ing and other applications attempting to send messages to 
data between the network or communications media 530 and 5 the network. In one embodiment of the present invention, 
532, Other systems 501, 507-517 appear on only one the network administrator monitors the nodal happiness 
network. factors set as a read only variable by each node, and can 
On any given network or communications medium, one g^just jj^e maximum bandwidth allocation per node accord- 
or more administrators may be present, assigning allocations jngjy Although users at each node might change the tele- 
of bandwidth to each of the nodes (computer systems) on the conferencing application or otherwise demand additional 
network or communications medium. For example, system bandwidth, for example, by turning off data compressors or 
501 can be assigned a maximum bandwidth allocation by a iransmilling in stereo, the node cannot reset or alter the 
network administrator. In some embodiments, a network maximum bandwidth allocation determined by the network 
administrator allocates bandwidth immediately; in other administrator. 

embodiments, the administrator waits until bandwidth use of , ... . , 1 1 • . u 

... ,. . , 15 Iq one embodiment, a network administrator publishes 

the network or communications medium reaches a prede- ... ^ , r u ^ *u I »i. 

. J , . f . i_ , . j.r „ one variable over the network for each of the nodes on the 

termined value before aUoca mg maxunum bandwrfth alio- ^^^^ ^ ^^^^ ^^^j^^ ^ 

cations. In some embodiments, onlv some of the systems are ^ J , • T, , . • j . u j 

, • . J 11 The network receives the variables determined at each node, 

assigned a maximum bandwidth allocation, while others are , . , 1 j ♦ - a c *u 

. J. . u • • J ♦ and each system receives the value determined for the 

not; m other embodiments, each system is assigned a maxi- • ui u ^ • ♦ * tu f • ui 

u A 'A^u II .u u »u II f- . variable by the administrator. The four variables are: 

mum bandwidth allocation, though the allocations are not ^ 

uniform throughout the cluster of computer systems coupled »be current total bandwidth bemg used for all conferenc- 

to the network or communications medium. As will be functions on each particular machine, measured m 

explained below, the administrator receives certain values embodiment m bytes per second; 

from the other systems coupled to the same network or 25 ^he number of active applications that are capable of 

communications medium, and these values can change over sending messages over the network in the immediate 

time, so that the allocations can also change. For example, future, a value that may be zero if the particular 

a system may discontinue transmission of data, or higher- machine is merely receiving (and not sending) mes- 

priority users may begin. As will also be explained below, sages; 

processes running on the client (that is, non-administrator) 33 a maximum allowed bandwidth per node, assigned by the 

nodes also receive values from the network or communica- administrator; 

tions medium, the values including the maximum bandwidth ^^d the number of active connections on the node, 

allocation. At each client node that receives such an alloca- variables can contain values pertaining to any group 

tion value, either aU applications or a group of appUcations bandwidth usere, although in the preferred embodiment, 

in a selected class are limited in their ability to send data to 35 the g^up of bandwidth users consists of the group of 

the network or communications medium, the limit imposed teleconferencing applications. It will be apparent, however, 

by vanous embodiments of the present mvention. that the group of all applications, any group of processes 

Hie present invention includes in one embodiment a operating below (or above) the level of applications, or even 
means for a network administrator to control the bandwidth hardware could have been selected, 
used by each system node in a distributed network, and 40 With the exception of the allowed bandwidth per node, the 
further allows each node to allocate among the applications values are determined by each non-administrator node and 
running thereon the bandwidth in a fair manner. The network provided to the administrator via the network. The admin- 
administrator can alter the bandwidth allocation among the istrator node thus monitorsi total bandwidth use by each 
various workstations, servers, or other processing nodes in node, the number of active applications currently transmit- 
the network, thus reallocating bandwidth among the nodes. 45 ting (that is, sending) data over the network from each node, 

The network includes an administrator node, operated by and the number of connections at each node, 

a network administrator. The network administrator may be The number of connections at any given node may be 

controlled by a person, or by a computer program. Other considered a total of the fan out values taken over all active 

embodiments allow some management functions to be applications. As stated above, the fan out is the number of 

shared by two or more processes on the manager node, so separate copies of teleconferencing data that must be sent to 

Although the functions of the administrator may in some the network or communications medium due to the number 

embodiments be performed by two or more manager nodes, of receivers participating in the teleconference. If a feature 

in general the described embodiment includes only one called ''multi-cast" is available, then all addressees can 

administrator performing all network administration func- receive the same copy, and only one need be sent, and the fan 

tions. Various signals are communicated from each non- 55 out is one. If multi-cast is not available, then a separate copy 

administrator system over the network to the administrator, is sent to each recipient, and the fan out is the number of 

and signals are received from the administrator. According recipients. If several applications are running on ia computer 

to these signals, the described embodiment of the present system or if the computer system is engaged in several 

invention locally manages network bandwidth used by teleconferences, the fan out of each is totaled to derive the 

applications operating thereon. eo number of connections at the node. This total number of 

A network administrator detects the additional network connections is provided to the network, 

bandwidth demand, and, according to one embodiment of In response to these values from the various non- 

the present invention, sets a bandwidth maximum allocation administrator nodes, the administrator assigns a maximum 

for each node. If one teleconference requires greater band- bandwidth to each node. The network administrator can also 

width than another, the network administrator can set the 65 determine a priority for bandwidth use among applications, 

bandwidth allocations differently for the nodes participating or can allow system processes on each node to determine 

in the different teleconferences. At the nodes that participate priority. The maximum bandwidth is provided over the 
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network to each of ihe non-administralor nodes. The admin- ingBandwidih maintains 603 a running average of band- 
isirator is not limited in bandwidth allocation; for example, width demand. The running average maintained by Blue- 
maximum bandwidlhs need not be uniform across a net- DolUsingBandwidth eliminates transient bandwidth spikes, 
work. Different nodes have different bandwidth needs and by producing an average of bandwidth demand for each 
different priorities: Some nodes, for example ATM switches, 5 application currently demanding access to the network, and 
have very large bandwidth availability; other nodes may be constantly or periodically determines the average number of 
daisy chained via an ethemet connection to a large network ^3^^^ per second each application has attempted to send to 
of nodes, each of whom is contending for bandwidth. Also, "^^^^^^/^^ ^^e past predetermined number of seconds, 
if a network is distributed into segments interconnected via nj^^^ ""S^ implemented using the 
routes, local boxes, or ethemet boxes, each node may be lo ^ " 
given a larger bandwidth allocation, since nodes in each 

segment may be sending simultaneously. Because of these _BlueDotUsingBandwidtb( 

and other non-uniform requirements, different nodes can be ciobaisHandie gh, 

allocated different bandwidth allocations. long fanom. 

Because only the adminisurator has access to the maxi- 15 . , 

mum bandwidth, only the administrator can change the oiotmisFtr gp - ''gh; 

maximum allowed bandwidth of any machine on the net- gp->ciistomer - TcConnection; 

work. Without this access, no machine can change even its gp->bandwidih - (bw + gp->iastBandwidtii) / 2; 

own maximum allowed bandwidth. gp->!asiBandwidth + bw, 

_ . , . , /. . gp->fanoul - fittnoul; 

Occasionally, a machine runs several conferencing apph- 20 UpdatcValucs(gp.>proccss->umvcrsals); 

cations having different fan outs and may also be sending rciurii(noErr); 

files or faxing documents over the network, sometimes to } 

other nodes involved in a particular conference, and some- ~— — — ^— — 

times to other nodes. As indicated above, however, the BlueDotUsingBandwidth calls Update Values 605, which 

maximum bandwidth allocated by the administrator applies 25 actually performs the steps of determining the values of the 

only to the selected group of applications, e.g. in the variables mentioned above (fan out/number of connections, 

described embodiment, only to teleconferencing applica- number of applications, and total bandwidth being used). As 

tions. Thus, only teleconferencing applications are implemented according to one embodiment of the present 

bandwidth-limited by this embodiment of the present inven- invention. Update Values is shown in FIG. 6. 

tion; other applications can use bandwidth unresu-ictedly. 30 Update Values determines the number of conferencing 

Cbmputer systems on a network may use less than all the applications that are running on the system. This is deter- 

bandwidth assigned to them. Although an assignment of mined by maintaining a table in which all conferencing 

bandwidth from the administrator serves as a maximum, the applications provide data when the applications run the 

current bandwidth being used may be far less than the embodiment of the present invention. For each application, 

assigned maximum; in fact, the current bandwidth being 35 the number of connections (i.e., the fan out associated with 

used may be zero, for machines that are receiving data the application) is inserted into the table, along with the 

without sending data over the network. bandwidth being used by each application (i.e., the data 

In a system-level aspect of the present invention, the transmission rate multiplied by the fan out). All of these 

client processor reacts to the maximum bandwidth allocation . values are stored in the table each time any of the Blue Dot 

sent to the system by the administrator. In one embodiment, 40 processes are called, and the values are provided to Updat- 

the Blue Dot process includes the following "external" e Values. The system-level total of these values taken over all 

routines, which exchange data with the various applications applications are also provided to the network, 

that call the Blue Dot process: BlueDotUsingBandwidth, Update Values operates across applications. Update Values 

BlueDotGimmeBandwidth, and BlueDotQueryHappiness. includes a first 602 loop that counts the number of confer- 

Each of these will be discussed in detail, and one embodi- 45 encing applications. The number of applications is initially 

ment of each presented. set at zero 604. Each process is counted 606, until the final 

BlueDotUsingBandwidth monitors bandwidth use, deter- application has been counted. Nested within loop 602, 

mined by accumulation. In one embodiment, monitoring of Update Values proceeds to second loop 608 that totals the 

bandwidth is performed by a data splitter that periodically nimiber of conferencing connections and also totals the 

calls BlueDotUsingBandwidth. The process BIueDotUsing- 50 current bandwidths being used by all of the individual 

Bandwidth exchanges information with the lower-level soft- applications. The second loop begins at the first process 610, 

ware serving each application, calculates the bandwidth and then proceeding through the processes that are engaged 

used, calculates the fan out (i.e., the number of copies of in a teleconference, adding the fanout and the bandwidth to 

each packet that must be provided to the network or com- each value 612. The total number of connections is also kept, 

munication medium) by each application, and calculates the 55 Once the last process has been tallied. Update Values 

total number of conferencing applications participating with proceeds to a subprocess that detects whether someone at a 

Blue Dot. Thus, BlueDotUsingBandwidth derives the three client (non-administrator) node has attempted to alter the 

values corresponding to the three variables produced by the bandwidth allocation. This is accomplished by detecting 

node. Each of these values is stored in a location where all whether certain function sets have been manipulated such 

other applications on the system can find the values (and 60 that the function sets cannot be used by Update Values, 

thereby update the values further). A data-splitter monitors Update Values also includes a variable "hacker" that is used 

bandwidth use, and calls BlueDotUsingBandwidth periodi- to determine whether a user of a system who does not have 

cally. access to the permissions associated with network adroinis- 

In one embodiment of the present invention, shown in tration is nevertheless attempting to tiun the BlueDot pro- 

FIG. 5 BlueDotUsingBandwidth records 601 the bandwidth 65 cess off. In other words. Hacker becomes non-zero when 

used, in bytes per second, for each appfication on the node tampering by someone other than the administrator is 

attempting to send data over the network. The BlueDotUs- detected. When hacker is set, the system assigns a small 
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allowed bandwidth. Hacker determines whether a user at a 
particular node has attempted to override the bandwidth 
allocation set by the network administrator, and, if unautho- 
rized tampering with the value set by the network adminis- 
trator is detected 616, hacker sets a standard bandwidth 
allocation 618. Hacker allows the network administrator to 
control the bandwidth used by a particular application. 
Hacker determines whether a user at a particular node has 
attempted to override the bandwidlh allocation set by the 
network administrator, and, if unauthorized tampering with 
the value set by the network administrator is detected, 
hacker sets a standard bandwidth allocation, 'llie standard 
allocation, in one embodiment, is much smaller than might 
otherwise be allocated. 

Update Values then stores the four variables where other 
applications can find. them, using the ChokerSet processes 
620. The table also includes a predictive value of the number 
of bytes per second the application may be expected to 
attempt to send over the network over the next brief period 
of time, taking fan out into account. Thus, if an application 
is expected to send a 10,000 byte per second communication 
over the network with a fan out of two without multi-casting, 
the table would contain a value of 20,000. For example, 
update values might accumulate the total number of bytes 
each application has attempted to send over the network for 
the past five seconds, and, by dividing the total by five 
seconds, determines the average bandwidth use. 

One embodiment of Update Variables may be imple- 
mented as the following code: 



Update\^lues( 

UniversalBitsPtr ub 

){ 

GlobalsPtr gp; 
ProcessStufiPtr 

ps; 

long connections, bandwidtli, apps; 
connections • 0; 
bandwidth = 0; 
apps » 0; 

for(ps - (ProcessStuSPtr) ub->processe$.qHead; ps; ps - 
(ProccssStuflfPtr) ps->qUnk) { 
apps++; 

for(gp - (GlobalsPtr) ps->in8tances.qHead; gp; ^ *■ 

(GlobalsPtr) gp->qLink) 

if(gp->customer — TbConnection) 

{ 



gp->CEUiout; 

gp->bandwidth * gh->fanout; 

) 



} 



} 



if(ub-> hacker) 

ub->allowed » kTeenyBit; 

else{ 

EnterOodeResourceO ; 

ChokcrSctActivcAppltcalions(apps) ; 
CbokerSetActiveComiections(connections) ; 
CbokerSetCurrentBandwidth(bandwidth) ; 
ChokerGe tAlIowedBandwidth(&ub->allowed) ; 
LeaveCodeResourceQ ; 

} 

ul>->used « Ixindwidth; 



In addition to BlueDolUsingBandwidth, the embodiment 
of the present invention described above also includes a 
routine BlueDotGimmeBandwidth, which is also called 
periodically. As implemented according to one embodiment 
of the present invention, BlueDotGimmeBandwidth is 
shown in FIG. 7. According to one embodiment of the 
present invention, each application not only stores the three 
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variable described above (i.e., the current total bandwidth 
being used for all conferencing functions on each particular 
machine, the number of active applications that are capable 
of sending messages over the network in the immediate 
future, and the number of active connections), but also stores 
a minimum and maximum bandwidlh lhat are desired by the 
application. Although these values are detemiined by the 
application, not by the embodiment of the present invention, 
their values are read by BIuedotGimmeBandwidth. Blue- 
DotGimmeBandwidth examines the bandwidlh demands of 
the applications running on the node, and the minimums and 
maximums bandwidth requests mentioned above with 
respect to the tabic maintained by Update Values. The mini* 
mum and maximum bandwidth requests arc limited to 
predetermined valuer if the minimum requested is negative 
or zero, then the minimum requested is reset to one 702. If 
the maximum requested is for some reason less than the 
minimum, then the Maximum is set to at least one greater 
than the minimum 704. 'lliese limits prevent certain types of 
mathematical errors from occurring at the node. Then, a total 
minimum bandwidth request for an application is 
determined, by multiplying the bandwidth requested mini- 
mum by the fanout 710. This calculates the bandwidth 
requirements of the application to communicate with each 
recipient of the teleconferencing messages. Once the mini- 
mum and maximum bandwidlh requested by each applica- 
tion is determined, BlueDotGimmeBandwidth calls 
UpdateAllocations 708. As explained below, UpdateAlloca- 
tions tries to allocate to each application an amount of 
bandwidth between the minimum and the maximum. If less 
than the minimum demanded by a program is available, 
however, then zero is assigned. Also, no application gets 
more than its requested maximum. Finally, each application 
receives an allocation described in a bandwidth per connec- 
tion 710. 

Software associated with an application (generally, a 
low-level program called by a conferencing application as 
part of the I/O routines of the application) can thus request 
an additional share of the bandwidth allocated by the admin- 
isU-ator. For example, a user changes operating parameters of 
a teleconferencing application by enlarging a window on a 
screen (thus increasing the number of pixels per video 
frame), or switching to a less effective codec, or transmitting 
sound in stereo instead of mono, then at a lower level 
software associated with the application requests additional 
bandwidth from a process mnning according to one embodi- 
ment of the present invention. The lower level software 
associated with the application provides the request by 
providing a minimum and a maximum bandwidth, and also 
by providing a fan out and a priority. The software associ- 
ated with the teleconferencing application provides a request 
to one embodiment of the present invention, upon determin- 
ing that the application will run more efficiently with addi- 
tional bandwidth. 

BlueDotGimmeBandwidth may be implemented accord- 
ing to the following code: 



60 



_BlueDotGimmeBandwidih( 
GlobalsHandle 



65 



long 
long 
short 
short 

GlobalsPtr 
gp->custonicr • 



minBW, 

maxBW, 
priority, 
fan out 

gp - 'gh; 

'itFlowcr; 
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-continued ^o"S as there are any processes that have received less then 

_ the stated maximum thereof and so long as there is unallo- 

*^*^'"'in^iiiBw' cated bandwidth remaining, UpdaleAllocalions divides the 

if(maxBW <=minBW) lotal remaining bandwidth by the nuinber of processes have 

maxBW - minBW +1; 5 received less then their maximum, and attempts to allocate 

gp->tninRequc5tcd - minBW • fan out; ^ach process the pro-rate share of the remaining band- 

gp->maxRcqucstcd - maxBW • &n out; ^-^^^ maximum for the process, until either all 

gp'->pnonly « pnonty; , • , , . • ... . • . . • 

UpdateAllocations(gp->proccss->universals) ; processes have received their maximum or all bandwidth is 

return(gp->aiiocated / fan out) ; exhausted. ALLOCATED 840, CONSUMERS 842, AVAIL- 

} JO ABLE 844, and the OUOTA846 vary, but provide allocation 

of the bandwidth among the other applications. The appli- 

After calling UpdaleAllocalions, BlueDolGimmeBand- cation is iheo informed of its new allocation. Although in 

width provides the maximum allocation of bandwidth per this embodiment of Ihc present invention, the class of 

copy (taking fan out into consideration), for each process applications selected for allocation by the administrator is 

seeking transmission access to the netwodc. 15 the class called ''conferencing applications/' it will be appar- 

UpdateAllocations resets the allocation of bandwidth of ent that other applications could have been selected. It will 

each process that sends data to the network or communica- be apparent that the group of applications, or even other 

lion medium. As implemented according to one embodiment types of processes, could have been selected. All of these 

of the present invention, UpdaleAllocalions is shown in values are all stored in the table, and are all provided to 

FIGS. 8A, 8B, and 8C. UpdaleAllocalions includes a first 20 Update Values as well as the network, 
loop, that iterates through the processes seeking network 

transmission access and determines (1) the priority of each — 

process, and (2) the total of all the allocations assigned by UpdaicAllocations may be implemented by the following code: 

UpdaleAllocalions the last time UpdaleAllocalions was updatcAllocations( 

called. To determine the priority for each process and the 25 UnlversalBitsPtr ub 

total allocation, variables ALLOCATED and MAXPRIO are ){ 

initially set to zero 802. Starting at the first process 804, BiobakPir gp; 

UpdaleAllocalions iterates through each process, delermin- . ProccssStufiPtr 

ing whether the priority of the particular process is greater ' long allocated, available, quota; 

than MAXPRIO 806; if so, the value of MAXPRIO is 30 shoit prio, maxprio, consumers; 

changed to priority of the process 808. Whether or not the allocated - O; 

particular process is of the highest priority, the bandwidth of foj(^ = (Proci.« ^ 

the process is added to ALLOCATED 810. The iteration (ProcessStuffPtr) ps->^Liiik) ' 

continues until the last process has been counted 812. foi(gp - (GlobalsPtr ps->instaaces.qHead; gp; gp - 

The variablesALLOWED and USED are determined, and 35 (GlobalsPtr) gp.>qLink) { 

ALLOCATED and AVAII^LE arc calculated 820. When if(gp->custoiner !- TcFia«.er^ 

unauthorized bandwidth users at the node are using if(Q)->priority > masprio) 

bandwidth, the AVAILABLE bandwidth is reduced. mazprio - gp- 

If AVAILABLE is less than or equal to zero, then no >prioriiy; 

bandwidth remains to allocate, and UpdaleAllocalions ends 40 ^gp^aifooatS 

861. If bandwidth remains, however, then AVAILABLE is j 

set to the maximum of AVAILABLE and ALLOWED 862. consumers = O; 

UpdaleAllocalions then assigns minimum bandwidth to available - ub->allowed + (allocated - ub->used); 

the processes having the highest priority. Starting at the *^^*^euirir 

highest priority 822, UpdaleAllocalions identifies all the 45 if(avaUablc > ub->allowed) 

processes (starting with the first 824 ) having the highest avaUabie - ub->aiiowed; 

priority and allocates to each the minimum bandwidth for(prio -> majqprio; maxprio - 0, prio; prio - maxprio) 

requested by the process 826. A runntog total AVAILABLE . ^,^^yrr^^^ ' 

is reduced 828 by the bandwidth so allocated, the variable foi(gp . (GlobalsPtr) ps- 

Storing the total amount of bandwidth that can be assigned 50 >instance8.qHead; gp; gp - (GlobalsPtr) gp->qLink) 

within the limit imposed by the administrator. Each process ( ........ 

at the given priority is assigned bandwidth so long as ^"^^"^^f^riilbii 

AVAILABLE is not zero 830, and then UpdaleAllocalions >minRequested) { 

turns to the next-highest priority, etc. until each process has gp- 

at least the minimum requested by the process. If possible, 55 >aiiocated - gp->minRequcsted; 

UpdaleAllocalions give at least the minimum bandwidth to ^^^^^^''^ - &^>^^^^^^ 

° consumers++; 

each process. if(avaiiablc 0) 

The number of applications that have received their return; 

minimum, is labeled the CONSUMERS. If there are con- } 

sumers (i.e., applications that could receive an additional 60 m^rio ^ 

bandwidth allocation without exceeding their maximum) >pnoriiy; 

and bandwidth is available 832, then a quota is defined 834. } 

The quota represents a small portion of bandwidth than can wtiUe(consumer8 > o) { 

be reassigned. Starting at the first process that has received "^^^J^ '^'jj^'''^ ' consumers; 

less than the maximum bandwidth requested (i.e., the first 65 return; 

consumer) 836, UpdaleAllocalions proceeds through each for(ps - (ProcessStuffPtr) ub->proccsse5.qHead; ps; 

process giving the process more bandwidth. Repeatedly, so 



for(ps = (ProcessStuffPtr) ub->processes.qHead; ps; ps « 



if(available >- gp-' 



• 
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-continued process can use. If the amount allocated is less than the 

— ^— — — — — minimum, then the score is set to zero. The amount that the 

UpdateAllocations may be impiemenled by the rollowing code: process can USe is determined in UpdateAllocationS, 

~ — rTTT described below. If the amount allocated is equal to the 

ps - (Prt)cessSiuffPir) sp.>qUiik) ^^^^^ ^ (oiobalsPtr) ps- 5 minimum, then the happiness score is 50%, if the amount 

>insiances.qHead; q); gp - (GiobaisPir) gp->Lmk) { allocated is less than the minimum, then the happiness score 

if (!gp->aiiocated) is 0%, and if the amount allocated is equal to the maximum 

coniinuc; (or greater), then the allocation is set to the maximum 

if((gp->allocated + quota) requested and the happiness score is 100%. 

>-gp->inaxRequestcd) { BlueDolQueryHappiness provides information to the 

consumers--; JQ ... .,. . .. . 

available— apphcations. As illustrated with respect to update Values, 

(gp->inaxRequested - gp->allocated) ; Blue Dot includes subroutines that operate across 

gp- applications, and each application provides information to 

>aUocatcd - gp->maxRcqucstcd; Blue Dot; as illustrated with respect to 

^'^^^i „,.,:km»__ BlueDotGimmeBandwidth, this information includes a 
15 maximum bandwidth request for each network process 

gp- serving a conferencing application. 

>allocated +- quota; The average of all the scores is the happiness factor, as 

} illustrated in one implementation by the following code: 



available -» 

quota; 



if(availab]e — 0) 

return; 

} 

} 

} 
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_BlueDotQueryHappiness( 

GlobalsHandle gh 

){ 

GlobalsPtr gx - *gh; 



|=& Although not absolutely necessary for operation, several u^*^^**^b' Pt b- 

Q embodimentsof the present invention also includes a routine 25 Pr^s'StuWir' ps- 

^ BlueDolQueryHappiness. As implemented according to one ^^^^^^ score; 

D embodiment of the present invention, BlueDotQueryHappi- gx->cusiomer ■ TcApplication; 

nessis shown in FIG. 9. The routine BlueDotQueryHappi- ub = gx->process->universaIs; 

S5» ness monitors how the bandwidth allocated to any given ^^^^ " 

^ node is being parceled out among the conferencing appU- 30 . (OlobalsPlr) ps.>proc:esses->inslaaces.qHead; gp; gp - 

s y cations and can also provide a visual indicator of how the (GlobalsPtr) gp->qLmk) 

^ available bandwidth is being parceled out. This is accom- if(gp->customer — TcFiower){ 

^ plished by calculating, in some embodiments, a "happiness" h r 

^ factor for each application, and in some embodiments also ^P*^' °'^'*'score +-"50 + (5o'-Tg/>aiiocated - 

3 calculating a global happiness factor for each machine. The 35 gp.>minRequestcd)) / (gp- >maxRequested - gp->minRcqucstcd); 

^ happiness factor can be visually presented to a user so the } 

user can see the amount of bandwidth assigned within the return(count ? score / count : 100); 

^ machine to each application. ^ 

D To calculate the happiness factor, the process compares 

^ the current bandwidth being allocated to the process for 40 A happiness color may be assigned, such that the color is 

l=s| conferencing functions with the maximum bandwidth red when the happiness factor is less than 0%, blue when the 

requested, and determines a first ratio. Thus, at each work- happiness factor is 100%, and purple when the happiness 
station or node, an "application happiness" factor corre- factor is between 0% and 100%. 

sponding to each application may be calculated, indicating The described embodiment of the present invention can- 
how much of the bandwidth desired by the application is 45 not force other applications to use less bandwidth, but can 
available to the application. As stated above, although in this provide feedback to the other applications by informing 
embodiment of the present invention the administrator them that there is some interference among applications at 
assigns a maximum bandwidth for conferencing the network interface. Thus, other applications may consult 
applications, it will be apparent that any group of BlueDolQueryHappiness to determine whether data gener- 
applications, or even a group of other types of processes, 50 ated by a particular application is reaching the network, and, 
could have been selected. if not, whether the reason is because higher priority or other 
In one embodiment, a visual embodiment of the happiness applications are usurping bandwidth allocation. In such an 
indicator is presented as a red dot when the corresponding embodiment, the application can switch to a lower band- 
happiness factor is 0 percent, a purple dot when the corre- width use, turn on additional data compression, send fewer 
sponding happiness factor is between 0 and 100 percent, and 55 frames, or otherwise reduce bandwidth use to allow other 
a blue dot when the corresponding happiness factor is 100 applications to proceed more efGciently, or in the alternative 
percent- llie happiness factors may be displayed as colored may increase bandwidth demand to gain greater access to 
dots on the screen of a monitor or connected to the machine. the network. Depending on the particular application, win- 
If the maximum bandwidth allocated to the machine by the dow size might be reduced, sound may be less complex, or 
administrator is greater than the total of all the maximums 60 additional users seeking access to the teleconference may be 
over all the processes trying to send data to the network, then rejected. 

all the processes are able to send data at their full data rate During a teleconference, additional users may enter the 
(bandwidth) and the "happiness" is 100%. teleconference and thereby increase the fan out. The low 

BlueDolQueryHappiness otherwise iterates through all level flow control process detects the additional fan out, and 

the connections used by the appHcation and assigns a score 65 provides the fan out update to BlueDolQueryHappiness. 
to each, the score being 50 points plus half the percentage of BlueDolQueryHappiness then updates the table maintained 
the difference between maximum and minimum that the by the blue dot process. Because multiK:ast may not be 



